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Purpose: To assess the reproducibility of circumpapillary retinal nerve fiber layer (cpRNFL) thickness measurement 
(measurement agreement) and its color-coded classification (classification agreement) by Cirrus spectral domain 
optical coherence tomography (OCT) in pseudophakic eyes. 

Methods: Two-hundred five participants having glaucoma or glaucoma suspected eyes underwent two repeat- 
ed Cirrus OCT scans to measure cpRNFL thickness (optic disc cube 200 x 200). After classifying participants 
into three different groups according to their lens status (clear media, cataract, and pseudophakic), values of 
intra-class coefficient (ICC), coefficient of variance, and test-retest variability were compared between groups 
for average retinal nerve fiber layer (RNFL) thicknesses and that corresponding to four quadrant maps. Linear 
weighted kappa coefficients were calculated as indicators of agreement of color code classification in each 
group. 

Results: ICC values were all excellent (generally defined as 0.75 to 1.00) for the average and quadrant RNFL 
thicknesses in all three groups. ICC values of the clear media group tended to be higher than those in the cat- 
aract and pseudophakic groups for all quadrants and average thickness. Especially in the superior and nasal 
quadrants, the ICC value of the cataract group was significantly lower than that of the clear media and pseu- 
dophakic groups. For average RNFL thickness, classification agreement (kappa) in three groups did not show 
a statistically significant difference. For quadrant maps, classification agreement (kappa) in the clear media 
group was higher than those in the other two groups. 

Conclusions: Agreement of cpRNFL measurement and its color code classification between two repeated Cir- 
rus OCT scans in pseudophakic eyes was as good as that in eyes with clear crystalline lens. More studies are 
required to ascertain the effect of lens status on the reproducibility of Cirrus OCT according to different stages 
of glaucoma patients. 
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Optical coherence tomography (OCT) has become a 
popular means of diagnosing and determining progression 
of glaucoma as it allows noninvasive imaging of the retinal 
nerve fiber layer (RNFL). Cirrus spectral domain (SD) OCT 
(software version 4.0.1; Carl Zeiss Meditec, Dublin, CA, 
USA) utilizes SD OCT technology to acquire OCT data 
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with better resolution (5 [im compared with approximately 
10 |im axial resolution in tissue) about 70 times faster 
(27,000 vs. 400 A scans/sec) than time-domain (TD) OCT 
technology. Previous studies confirmed that peripapillary 
RNFL thickness measurements by Cirrus SD OCT were 
very reproducible both in healthy and glaucomatous eyes 
[1,2]. 

When analyzing circumpapillary RNFL (cpRNFL) 
thickness in glaucoma patients, reproducibility is an 
important reliability index, regardless of the imaging 
technique used. There have been many potential explanations 
for variability in cpRNFL thickness measurements using 
OCT. Factors such as cataract, signal strength (SS), pupil size, 
type of scan, the quadrant measured, and the thickness of 
RNFL all may influence the overall scan quality and 
calculated RNFL thickness [3-7]. Youm et al. [8] reported 
that the average SS and relative SS change were correlated 
with the reproducibility in RNFL thickness measurement 
using Stratus OCT, and glaucomatous eyes tend to be more 
variable than normal eyes. 

Glaucoma and cataract are frequent causes of vision loss 
among the elderly, and these conditions often coexist [9]. 
Cataract is a common cause of media opacity that can 
affect the quality of diagnostic imaging for glaucoma in the 
elderly. Although prior studies reported that the presence of 
cataract and cataract surgery might significantly affect the 
RNFL thickness measurement by OCT [10], no prior study 
has simultaneously compared the reproducibility of RNFL 
thickness measurement by OCT in pseudophakic eyes with 
those in clear media and cataract eyes. 

Thus, the current study aims to assess the reproducibili- 
ty of RNFL thickness measurement and its color code 
classification using Cirrus SD OCT in pseudophakic eyes, 
and then compare the obtained results with those in clear 
media and cataract eyes simultaneously. 

Materials and Methods 

Glaucoma and glaucoma suspect patients were consecu- 
tively enrolled from the Glaucoma-Cataract Clinic of Si- 
loam Eye Hospital from March 2012 to May 2012. The 
study was approved by the institutional review board and 
ethics committee of Siloam Eye Hospital, and complied 
using the tenets of the Declaration of Helsinki. Informed 
consent was obtained from all participants prior to their 



participation in the study. 

Upon initial evaluation, all participants underwent a 
complete ophthalmologic examination including best-cor- 
rected visual acuity (BCVA), intraocular pressure mea- 
surement using a Goldmann applanation tonometer, and 
slit lamp and fundus examination. Perimetry was per- 
formed by experienced technicians using the Humphrey 
Visual Field Analyzer (Cirrus OCT, Carl Zeiss Meditec) 
with the 30-2 SITA Standard algorithm. All cataracts were 
staged according to the slit lamp-based Lens Opacities 
Classification System (LOGS) III. 

Participants included those with a diagnosis of any form 
of glaucoma or glaucoma suspect with an age greater than 
60 years. Glaucomatous eyes were defined as those having 
glaucomatous visual field (VF) defects confirmed by at 
least two reliable VF examinations and the presence of a 
compatible glaucomatous optic disc that showed increased 
cupping (a vertical cup-disc ratio >0.7), a difference in ver- 
tical cup-disc ratio of >0.2 between eyes, diffuse or focal 
neural rim thinning, disc hemorrhage, or RNFL defects. A 
glaucomatous VF defect was defined as having three or 
more significant {p < 0.05) contiguous points with at least 
one at the p < 0.01 level on the same side of the horizontal 
meridian in the pattern deviation plot, classified as outside 
normal limits using the glaucoma hemifield test. Glauco- 
ma-suspect eyes were defined as those with glaucomatous 
optic disc, but showing normal VF test data. Individuals 
with 1) any other ocular pathology except glaucoma and 
cataract, 2) refractive error >5.0 or <-5.0 diopters, 3) histo- 
ry of ocular trauma or surgery (except for uncomplicated 
cataract surgery), 4) recent history of cataract surgery (<6 
months prior to the examination), or 5) presence of posteri- 
or capsular opacity or continuous curvilinear capsulorhex- 
is contracture were excluded from this study. 

All participants were categorized into three groups ac- 
cording to their lens status. Patients with a degree of cata- 
ract more than grade II by LOCS classification were grouped 
as the cataract group, and patients who had received un- 
complicated cataract surgery with "in the bag" implanta- 
tion of a Biovue (Ophthalmic Innovations International, 
Ontario, CA, USA) intraocular lens were grouped as the 
pseudophakic group. Participants with clear media were 
classified as clear media group. 

All individuals were evaluated with the Cirrus SD OCT 
(software version 4.0.1, Carl Zeiss Meditec) to measure 
cpRNFL thickness (optic disc cube 200 x 200 scan) twice 
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during the same day, with short breaks between each mea- 
surement. The OCT scan was performed by a single well- 
trained technician through a dilated pupil. Between each 
scan, the patient was asked to sit back and rest for a few 
minutes before proceeding to the next scan. The technician 
applied artificial tears before the subsequent scan, and then 
repositioned the participants. 

Optic disc cube protocol generates a cube of data through 
a 6 mm square grid by acquiring a series of 200 horizontal 
scan lines each composed of 200 A-scans. For analysis. 
Cirrus algorithms identify the center of the optic disc and 
automatically place a calculation circle of 3.46 mm diame- 
ter around it. The anterior and posterior margins of the 
RNFL are delineated, and after extracting from the data 
cube 256 A-scan samples along the path of the calculation 
circle, the system calculates the cpRNFL thickness at each 
point on the circle. Scans with misalignment, segmentation 
failure, or decentration of the measurement circle were ex- 
cluded from analysis. From the OCT database, the follow- 
ing data were collected: two repeated measures of cpRN- 
FL thickness and their stoplight color code from quadrant 
maps, two repeated measures of average RNFL thickness 
with stoplight color classification, and SS. Scans with high 
SS values were defined as those with scores greater than or 
equal to 5 in two consecutive scans, while other scans were 
defined as scans with low SS (scans showing a SS of <5). 

Statistical metiiods 

When data from both eyes were eligible for analysis, 
only one eye from each patient was randomly selected and 
used for data analysis. No participant was excluded based 
on SS score. 

The method employed to determine the reproducibility 
of RNFL thickness measurement between two repeated 
OCT scans (measurement agreement) was the intra-class 
correlation coefficient (ICC). Linear weighted kappa 
coefficients were calculated as indicators of agreement for 
RNFL thickness classification between two repeated OCT 
scans (classification agreement). When the number of 
categories was less than two by two, the result was marked 
as 'not available' due to insufficient number of categories to 
perform the classification agreement test. Coefficient of 
variation (CV) and test-retest variability were also computed 
to determine the reproducibility of the Cirrus OCT scan 
used in this study. The CV, expressed as a percentage (%), 



was calculated as the square root of the variance divided 
by the mean RNFL thickness of two repeated measures. 
Test-retest variability, measured in micrometers, was 
calculated as twice the square root of the variance among 
two repeated measures. 

Inter-scan measurement difference, calculated by the 
RNFL thickness difference obtained between two repeated 
measures, was compared among groups using ANOVA 
and post-hoc multiple comparisons test. 

To determine the effect of signal strength on Cirrus 
OCT reproducibility, we performed Pearson's correlation 
analysis. After we categorized participants into two different 
SS groups (high SS and low SS), we calculated ICC and 
kappa values for each group. 

Data were analyzed using statistical software SPSS ven 
15.0 (SPSS Inc., Chicago, IL, USA) and R software ver. 
2.10.1 (GNU General Public License). A p-vahie less than 
0.05 was considered statistically significant. 

Results 

Of the 300 individuals initially enrolled in the study, 95 
eyes were excluded due to segmentation error, or scan 
circle decentration, in any of the repeated Cirrus OCT 
scans. In total, 205 eyes of 205 individuals were included 
for the final analysis. Participants' demographic and 
ophthalmic characteristics are shown in Table 1. 

After categorizing all participants into three groups 
(clear media, cataract, and pseudophakia), there were 73 
eyes in the clear media group, 74 eyes in the cataract 
group, and 58 eyes in the pseudophakic group, respectively. 
Among those three groups, there was no statistically 
significant difference in relation to age, gender, and 
proportion of glaucoma or glaucoma suspect. Logarithm 
of the minimum angle of resolution BCVA in cataract 
group was significantly worse than that in the clear media 
group (p < 0.001) and pseudophakic group (p = 0.009). 
The average SS in the clear media group was significantly 
greater than that in the cataract {p < 0.001) and pseudophakic 
groups (p < 0.001). Although the average SS score in 
pseudophakic eyes (4.99 ± 0.86) was greater than that in 
cataract eyes (4.71 ± 0.90), the difference did not reach sta- 
tistical significance (p = 0.176). 

To compare the measurement reproducibility of RNFL 
thickness between the three groups, ICC, CV, and test- 
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Table 1. Participant characteristics 



Clear media 
(n = 73) 



Cataract 
(n = 74) 



Pseudophakic 
(n = 58) 



/"-value 



Post-hoc analysis 



Age (yr) 
Female sex (%) 
Glaucoma : GS 
BCVA (logMAR) 



64.25 ±2.13 
49 (67.1) 
30 : 43 

0.016 ±0.077 



65.69 ±5.58 
42 (56.8) 
36 : 38 

0.124 ±0.184 



65.78 ±5.05 
39 (67.2) 
25 : 33 
0.051 ±0.086 



0.285 
0.331 
0.205 

<o.oor 



Cataract > pseudophakia (p = 0.009) 

Cataract > clear media (p < 0.001) 

Pseudophakia % clear media (p = 0.275) 

6.09 ±0.70 4.71 ±0.90 4.99 ± 0.86 <0.00r Clear media > cataract (p < 0.001) 

Clear media > pseudophakia (p < 0.001) 

Cataract % pseudophakia (p = 0.176) 

70 : 3 35 : 39 35 : 23 <0.001 ' Clear media > cataract (p < 0.001) 

Clear media > pseudophakia {p < 0.001) 

Cataract % pseudophakia (p = 0.136) 

GS = glaucoma suspect; BCVA = best-corrected visual acuity; logMAR = logarithm of the minimum angle of resolution; SS = signal 
strength. 

' % ' indicates similar values without statistically significant difference between two groups. 

Value from ANOVA or chi-square test; 'Pairwise comparison after ANOVA with Bonferroni correction; *High SS (SS >5 in two 
consecutive scans) and low SS (SS <5 in either scan). 



Average SS 



High SS : low SS* 



Table 2. ICC and Fleiss' generalized kappa of probability codes of circumpapillary retinal nerve fiber layer thickness measure- 
ments obtained using Cirrus optical coherence tomography 



Scan area 




ICC* 








Kappa value^ 






Clear 
media 


Cataract 


Pseudo- 
phakia 




Clear 
media 


Cataract 


Pseudo- 
phakia 




Average 


0.990 


0.974 


0.990 


Clear media 


0.902 


0.929 


0.874 


Clear media 




(0.984- 


(0.960- 


(0.983- 


% cataract 


(0.817- 


(0.857- 


(0.778- 


% cataract 




0.993) 


0.984) 


0.994) 


=^ pseudophakia 


0.987) 


0.999) 


0.970) 


^ pseudophakia 


Temporal 


0.971 


0.968 


0.958 


Clear media 


0.921 


0.857 


NA* 


Clear media 




(0.955- 


(0.950- 


(0.930- 


% cataract 


(0.821- 


(0.714- 




% cataract 




0.982) 


0.980) 


0.975) 


^ pseudophakia 


0.999) 


0.999) 






Superior 


0.990 


0.942 


0.979 


Clear media > cataract 


0.959 


0.807 


0.905 


Clear media 




(0.985- 


(0.910- 


(0.965- 


Pseudophakia > cataract 


(0.902- 


(0.708- 


(0.809- 


% cataract 




0.994) 


0.963) 


0.987) 


Clear media % pseudophakia 


0.999) 


0.907) 


0.999) 


% pseudophakia 


Nasal 


0.942 


0.841 


0.930 


Clear media > cataract 


0.864 


0.585 


0.563 


Clear media 




(0.909- 


(0.759- 


(0.885- 


Pseudophakia > cataract 


(0.713- 


(0.304- 


(0.184- 


% cataract 




0.963) 


0.882) 


0.958) 


Clear media % pseudophakia 


0.999) 


0.867) 


0.943) 


% pseudophakia 


Inferior 


0.990 


0.975 


0.985 


Clear media 


0.933 


0.931 


0.924 


Clear media 




(0.984- 


(0.961- 


(0.975- 


% cataract 


(0.870- 


(0.873- 


(0.851- 


% cataract 




0.993) 


0.984) 


0.991) 


% pseudophakia 


0.996) 


0.990) 


0.996) 


% pseudophakia 



ICC = intra-class correlation coefficient; NA = not available. 

' =^ ' indicates similar values without statistically significant difference between two groups. 

ICC values with 95% confidence interval in parenthesis, calculated with the two-way random effects model using the absolute agreement 
definition; 'Mean on top with 95% confidence interval in parentheses; *Due to insufficient number of categories to perfomi test. 
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Table 3. Coefficient of variation and test-retest variability of circumpapillary retinal nerve fiber layer thickness measurements 
with the Cirrus optical coherence tomography 



Scan area 



Coefficient of variation 

(%)• 

Clear Cata- Pseudo- 
media ract phakia 



/>-vaIue Post-hoc analysis 



Test-retest variability 



Clear 
media 



Cata- 
ract 



Pseudo- 
phakia 



p-value Post-hoc analysis 



Average 1.28 ± 2.49 ± 1.44 ± <0.001 Cataract > clear media 
0.98 1.87 1.05 (p< 0.001) 

Cataract > 
pseudophakia (p < 
0.001) 

Clear media % 
pseudophakia (p = 
1.00) 

Temporal 1.51 ± 2.61 ± 2.43 ± 0.03 Cataract > clear media 
1.57 3.23 2.92 (p = 0.038) 

Cataract % 
pseudophakia 
{p = 1.00) 
Clear media % 
pseudophakia 
(p = 0.148) 

Superior 1.79 ± 4.26 ± 2.52 ± <0.001 Cataract > clear media 
1.52 3.82 1.97 (p< 0.001) 

Cataract > 
pseudophakia 
(p = 0.001) 
Clear media % 
pseudophakia 
(p = 0.367) 

Nasal 2.39 ± 4.09 ± 2.88 ± 0.002 Cataract > clear media 

2.03 4.08 2.16 (p = 0.038) 

Cataract % 
pseudophakia 
(p=1.00) 
Clear media % 
pseudophakia 
(p = 0.148) 

Inferior 1.58 ± 3.54 ± 3.00 ± <0.001 Cataract > clear media 
1.40 3.44 2.73 {p< 0.001) 

Cataract % 
pseudophakia 
0 = 0.727) 
Clear media < 
pseudophakia 
(p = 0.009) 



2.05 ± 3.57 ± 2.17 ± <0.001 Cataract > clear media 
1.63 2.46 1.55 (p< 0.001) 

Cataract > 
pseudophakia (p < 
0.001) 

Clear media % 
pseudophakia 
(p= 1.00) 

1.76 ± 2.98 ± 3.02 ± 0.019 Cataract > clear media 
1.88 3.54 3.30 (p = 0.042) 

Cataract % 
pseudophakia 
(p= 1.00) 
Clear media % 
pseudophakia 
(p = 0.051) 

3.51 ± 7.47 ± 4.66 ± <0.001 Cataract > clear media 
2.71 6.85 3.65 (p< 0.001) 

Cataract > 
pseudophakia 
(p = 0.003) 
Clear media % 
pseudophakia 
(p = 0.532) 

2.85 ± 4.66 ± 3.54 ± 0.006 Cataract > clear media 
2.54 4.47 2.72 (p = 0.004) 

Cataract % 
pseudophakia 
(p = 0.182) 
Clear media % 
pseudophakia 
(p = 0.758) 

3.12 ± 6.02 ± 5.07 ± <0.001 Cataract > clear media 
2.79 5.30 3.97 (p< 0.001) 

Cataract % 
pseudophakia 
(p = 0.589) 
Clear media < 
pseudophakia 
ip = 0.025) 



' =^ ' indicates similar values without statistically significant difference between two groups. 

'Calculated as the square root of the variance divided by the mean thickness of two repeated measures; ^Calculated as two times the 
square root of the variance of two repeated measures. 
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Table 4. Comparison of inter-scan measurement difference between two repeated Cirrus optical coherence tomography scans 
among three groups 

Inter-scan measurement 
difference* 



Clear media Cataract Pseudophakia p-value' 



Post-hoc analysis 



Signal strength 
Average 



Temporal 



Superior 



Nasal 



Inferior 



0.49 ±0.53 0.54 ±0.62 0.40 ± 0.56 0.344 
1.45 ± 1.15 2.53 ± 1.73 1.53 ±1.09 <0.001* 



1.25± 1.33 2.11 ±2.50 2.14±2.33 0.019* 



2.48 ±1.91 5.28 ±4.84 3.29 ±2.58 <0.001' 



2.01 ± 1.79 3.30 ±3.16 2.50 ± 1.92 0.006- 



2.21 ± 1.97 4.26 ±3.74 3.59 ±2.81 <0.001* 



Cataract > clear media (p < 0.001) 
Cataract > pseudophakia (p < 0.001) 
Clear media % pseudophakia (p = 1 .00) 
Cataract > clear media (p = 0.042) 
Cataract % pseudophakia (p = 1 .00) 
Clear media % pseudophakia (p = 0.051) 
Cataract > clear media (p < 0.001) 
Cataract > pseudophakia (p = 0.003) 
Clear media % pseudophakia (p = 0.532) 
Cataract > clear media (p = 0.004) 
Cataract % pseudophakia (p = 0.182) 
Clear media = pseudophakia (p = 0.758) 
Cataract > clear media (p < 0.001) 
Cataract = pseudophakia (p = 0.589) 
Clear media < pseudophakia (p = 0.025) 



' =^ ' indicates similar values without statistically significant difference between two groups. 

Obtained by subtracting value of optical coherence tomography scan with lower one fi"om that of scan with the greater value; 'Value 
from ANOVA; 'Pairwise comparison after ANOVA with Bonferroni correction. 



Table 5. Relationship between signal strength and inter-scan retinal nerve fiber layer thickness measurement difference of repeated 
optical coherence tomography scans 



Inter-scan measurement difference 



Correlation coefficient^ 



Mean SS 



Difference in SS 



Average 

Temporal 

Superior 

Nasal 

Inferior 



-0.242 (<0.001) 
-0.135 (0.054) 
-0.184 (0.008) 
-0.174(0.013) 
-0.152 (0.029) 



0.426 (<0.001) 
0.281 (<0.001) 
0.230(0.001) 
0.322 (<0.001) 
0.199 (0.004) 



SS = signal strength. 

Obtained by obtaining the difference between optical coherence tomography scan values; ^Correlation coefficient from Pearson 
correlation with p-value in parentheses. 



retest variability values were calculated. Also, linear 
weighted kappa coefficients were calculated as agreement 
indicators of the probability code results for RNFL thickness 
analysis. Those values are shown in Tables 2 and 3. ICC 
values were all excellent (generally defined as 0.75 to 1.00) 
in average and quadrant RNFL thicknesses for all three 
groups. Especially in the superior and nasal quadrants, the 
ICC value of the cataract group was significantly lower than 



that of the clear media and pseudopahkic groups. However, 
the ICC values of clear media and pseudophakic groups 
were similar. In addition, in terms of inferior, temporal 
quadrant, and average RNFL thickness, differences of ICC 
values among the three groups did not reach statistical 
significance. In terms of the classification agreement (kappa) 
also shown in Table 2, the differences among the three 
groups did not reach statistical significance in the superior, 
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Table 6. ICC and kappa values in each group classified by signal strength 







ICC* 








Kappa value^ 






Scan area 


Clear 
media 




Pseudo- 
phakia 




Clear 
media 


Cataract 


Pseudo- 
phakia 




High SS (n = 


= 140)* 
















Average 


0.990 


0.974 


0.990 


Clear media 


0.900 


0.936 


0.892 


Clear media 




(0.985- 


(0.950- 


(0.981- 


% cataract 


(0.814- 


(0.814- 


(0.778- 


% cataract 




0.994) 


0.987) 


0.995) 


% pseudophakia 


0.986) 


0.999) 


0.999) 


% pseudophakia 


Temporal 


0.991 


0.981 


0.948 


Clear media > 


0.920 


0.883 


NA** 


Clear media 




(0.985- 


(0.963- 


(0.900- 


pseudophakia 


(0.820- 


(0.728- 




% cataract 




0.994) 


0.990) 


0.974) 


Cataract % 
pseudophakia 
Cataract = 
clear media 


0.999) 


0.999) 






Superior 


0.991 


0.951 


0.984 


Clear media > 


0.958 


0.910 


0.934 


Clear media 




(0.985- 


(0.905- 


(0.968- 


cataract 


(0.901- 


(0.814- 


(0.843- 


% cataract 




0.994) 


0.975) 


0.992) 


Pseudophakia % 
cataract 
Clear media % 
pseudophakia 


0.999) 


0.999) 


0.999) 


% pseudophakia 


Nasal 


0.946 


0.825 


0.947 


Clear media > 


0.862 


0.731 


0.533 


Clear media 




(0.914- 


(0.681- 


(0.898- 


cataract 


(0.711- 


(0.329- 


(0.086- 


% cataract 




0.966) 


0.908) 


0.973) 


Pseudophakia % 
cataract 
Clear media % 
pseudophakia 


0.999) 


0.999) 


0.980) 


^ pseudophakia 


Inferior 


0.991 


0.973 


0.984 


Clear media 


0.932 


0.881 


0.932 


Clear media 




(0.985- 


(0.947- 


(0.969- 


% cataract 


(0.868 - 


(0.770- 


(0.837- 


% cataract 




0.994) 


0.986) 


0.992) 


% pseudophakia 


0.996) 


0.992) 


0.999) 


% pseudophakia 


Low SS (n = 


65)' 
















Average 


NA^' 


0.974 


0.990 


Cataract % 


NA^ 


0.922 


0.848 


Cataract % 






(0.952- 


(0.975- 


pseudophakia 




(0.836- 


(0.682- 


pseudophakia 






0.986) 


0.996) 






0.999) 


0.999) 




Temporal 


NA* 


0.961 


0.971 


Cataract % 


NA^' 


0.833 


0.477 


Cataract % 






(0.926- 


(0.933- 


pseudophakia 




(0.596- 


(0.130- 


pseudophakia 






0.979) 


0.988) 






0.999) 


0.824) 




Superior 


NA* 


0.929 


0.964 


Cataract % 


NA*^ 


0.715 


0.864 


Cataract % 






(0.869- 


(0.916- 


pseudophakia 




(0.553- 


(0.676- 


pseudophakia 






0.962) 


0.984) 






0.878) 


0.999) 




Nasal 


NA** 


0.854 


0.908 


Cataract % 


NA** 


0.480 


0.646 


Cataract % 






(0.739- 


(0.796- 


pseudophakia 




(0.126- 


(0.117- 


pseudophakia 






0.921) 


0.960) 






0.834) 


0.999) 




Inferior 


NA* 


0.978 


0.985 


Cataract % 


NA** 


0.974 


0.912 


Cataract % 






(0.959- 


(0.966- 


pseudophakia 




(0.925- 


(0.794- 


pseudophakia 






0.989) 


0.994) 






0.999) 


0.999) 





ICC = intra-class correlation coefficient; NA = not available. 

' % ' indicates similar values without statistically significant difference between two groups. 

ICC values with 95% confidence interval in parenthesis, calculated with the two-way random effects model using the absolute 
agreement definition; 'Mean on top with 95% confidence interval in parentheses; *High SS (SS >5 in two consecutive scans) and low 
SS (SS <5 in either scan); *Due to insufficient number of categories to perfom test. 



144 



GA Kim, et al. Reproducibility of Cirrus OCT in Pseudophal<ic Eyes 



nasal, and inferior quadrants and average RNFL thickness, 
though kappa value from the pseudophakic group in the 
temporal quadrant was not available due to an insufficient 
number of categories to perform test. As shown in Table 3, 
the test/retest variability values of cataract group were 
significantly higher than those of the clear media group (in 
all quadrants including average RNFL thickness) as well 
as those of pseudophakic group (superior quadrant and 
average RNFL thickness). CV and test retest variability 
values of the pseudophakic group were similar to those of 
the clear media group in all scan areas, except the inferior 
quadrant. 

Table 4 provides the comparison of the inter-scan 
measurement differences in RNFL thickness between three 
groups. Just like the CV and test retest variability, the inter- 
scan measurement difference value of the cataract group 
was significantly higher than those of the clear media group 
(temporal and nasal quadrant) or even than those of the 
pseudophakic group (superior quadrant and average RNFL 
thickness). Also, the inter-scan measurement difference 
value of the pseudophakic group was similar to those of the 
clear media group in all scan areas except the inferior 
quadrant. 

The relationship between SS and inter-scan measurement 
difference with respect to RNFL thickness is summarized 
in Table 5. There was a significant negative correlation 
between mean SS of two repeated OCT scans and inter- 
scan measurement difference for superior (r = -0.184, p = 
0.008), nasal (r = -0.174, p = 0.013), inferior (r = -0.152, p = 
0.029), and average RNFL thickness (r = -0.242, p < 0.001), 
which means that the scans with lower signal strength tend 
to show increased measurement variability. In addition, the 
difference in SS, had a significant positive correlation with 
inter-scan measurement variation for all quadrants (p < 
0.05) and average RNFL thickness (r = 0.426, p < 0.001). 
In other words, as the difference in SS between two repeated 
Cirrus OCT scans increases, the inter-scan measurement 
difference also increases. 

As OCT manufacturers recommended that SS score of 
an acceptable image quality is 5 or higher, we categorized 
all participants into two groups according to their SS values, 
participants with high SS (SS >5 in two consecutive scans, 
n = 140) and those with low SS (SS <5 in either scan, n = 
65), then calculated ICC and kappa values for each group 
(Table 6). In comparison with Table 2, the scan results with 
all SS showed some differences. Considering the scan 
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Fig. 1. Bland-Altman plot analysis of the average retinal nerve 
fiber layer (RNFL) thickness measured by two repeated Cirrus 
optical coherence tomography scans. Note the greater variation 
between two repeated average RNFL thickness measurements in 
the cataract group than in the other groups. (A) Clear media. (B) 
Cataract. (C) Pseudophakic. STD = standard deviation. 



results of only the high SS, the ICC value of clear media 
was significantly higher than that of the pseudophakic group 
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in the temporal quadrant. In addition, the ICC value of the 
pseudophakic group showed no statistical difference from 
that of the cataract group in superior and nasal quadrants. 
Considering the low SS scan results, the reproducibility 
parameters (ICC, kappa value) showed no significant 
difference between cataract and pseudophakic groups and 
those in the clear group were not able to be calculated due 
to insufficient number of categories to perform test. 

Fig. 1 shows a Bland-Altman plot analysis of average 
RNFL thickness measured by two repeated Cirrus OCT 
scans in three groups respectively (A, B, and C). There was 
greater variation between two repeated average RNFL 
thickness measurements in the cataract group than in other 
groups. 

Discussion 

In the present study, we evaluated the reproducibility of 
cpRNFL thickness measurement and its color code 
classification by Cirrus SD OCT in pseudophakic eyes, and 
then compared the results with those in clear media and cataract 
eyes. As a result, ICC and kappa values of pseudophakic eyes 
were as good as that of clear media eyes despite a slightly 
lower average signal strength. CV and test retest variability 
of the pseudophakic group were also similar to those of clear 
media group except in the inferior quadrant. To our best 
knowledge, there has been no prior study that simultaneously 
compares reproducibility of Cirrus SD OCT in three different 
groups (clear media, cataract, and pseudophakic eyes). 

OCT is an important method used in diagnosing and 
determining the progression of glaucoma [11,12]. The newer 
SD OCT provides much faster and more detailed structural 
information than the previous TD OCT method [13,14], 
and has potentially improved its ability to diagnose and 
observe glaucoma progression [15]. Hong et al. [16] 
reported that the reproducibility of Cirrus HD OCT to 
analyze peripapillary RNFL thickness in healthy eyes was 
excellent compared with time domain Stratus OCT. In the 
current study, the agreement for average RNFL thickness 
measurement was excellent in all three groups (ICC ranged 
0.974 to 0.990), thereby confirming that RNFL thickness 
measurements by Cirrus SD OCT are highly repeatable. 

Cataract is a common cause of media opacity that can 
affect the quality of diagnostic imaging devices for glaucoma 
like OCT in the elderly. Clear optical media will optimize 



both forward and back light scattering, whereas media 
opacity caused by cataracts will increase light scattering 
and absorption. Previous studies using Stratus TD OCT 
reported that lens opacities may affect the RNFL thickness 
measurements [4,6,17], and the RNFL thickness measurement 
can be increased after uncomplicated cataract surgery [6]. 
The increase in signal strength and RNFL thickness 
measurement after cataract surgery may be the result of 
improved transmittance and reflectivity of the RNFL 
boundary after removal of opacified media, rather than 
actual RNFL thickening after cataract surgery. In terms of 
measurement agreement expressed as ICC, the cataract 
group showed the smallest ICC values compared to clear 
media and pseudophakic groups. Especially in some 
quadrants (superior and nasal), this difference reached 
statistical significance. There was no significant difference 
in ICC value between clear media and pseudophakic groups 
in all scan areas, implying that measurement agreement in 
pseudophakic eyes is as good as that in clear media eyes. 
High ICC value in pseudophakic eyes as in clear media eyes 
in results of all scan areas was similar with results of scans 
only with high SS. When we calculated the ICC of scans 
only with high SS, ICC in pseudophakic group also showed 
no difference with that of cataract group in the superior and 
nasal quadrants, which was different from the scan results 
considering all SS. 

One possible explanation for this is that the effect of low 
SS caused by lens opacity in the cataract group on RNFL 
measurement variability was minimized by exclusion of 
scans with low SS. 

Results regarding the RNFL color code classification 
from Cirrus OCT were quite interesting. For quadrant 
maps, the color code classification of the nasal quadrant 
appeared to be the most variable among all three groups as 
previously investigated [16]. Although the mean kappa 
values for the cataract group in temporal, superior, and 
nasal quadrants were slightly low, the mean kappa value of 
average RNFL thickness did not show a similar pattern. 
Moreover, these observations were consistent with a 
previous study, which reported poorer reproducibility in a 
smaller scan area using Stratus OCT [18]. No statistically 
significant difference in color code agreement was found 
among the three groups in all scan areas, except the 
temporal quadrant, in which test data was not available due 
to insufficient number of categories. Similar results were 
observed for scans with only a high SS score. A relatively 
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comparable agreement of color code was observed among 
the three groups in all scan areas despite the significantly 
lower ICC value of the superior and nasal quadrants in the 
cataract group. This observation might be due to rough 
classification of color code, which categorizes RNFL 
thickness into only four codes (white, green, yellow, and red) 
through comparison with an age-matched normative database. 
Therefore, small gaps in RNFL thickness measurements 
between two consecutive scans would be masked via the 
color code classification. 

The result of inter-scan measurement difference, CV, and 
test-retest variability were found to be higher in the cataract 
group, while values of the remaining two groups 
(pseudophakic and clear media group) were similar to each 
other in temporal, superior, nasal quadrants, and average 
RNFL thickness. However, only in the inferior quadrant, the 
inter-scan measurement difference, CV, and test-retest 
variability in the pseudophakic group were higher than 
those of the clear media group. There are some potential 
explanations for this observation. Of several statistical 
methods for assessing reliability, CV and test-retest 
variability can be caused by both intra-individual variability 
and inter-individual variability, in contrast to ICC values. In 
this study population, the ratio of glaucoma patients to 
glaucoma suspects was higher in the pseudophakic group 
(25 : 33, 75.8%) than in the clear media group (30 : 43, 
69.8%), as shown in Table 1. In eyes with optic nerve damage, 
localized RNFL defects are most often found in the temporal 
inferior sector, followed by the temporal superior sector [19]. 
Therefore, a relatively higher ratio of glaucoma patients to 
glaucoma suspects in the pseudophakic group and their 
higher inter-individual variability from different degrees of 
glaucomatous RNFL damage might contribute to higher 
inter-scan measurement differences, CV, and test-retest 
variability in the pseudo-phakic group than in the clear media 
group only in the inferior quadrant despite of similar ICC 
values. 

A previous study performed by the authors demonstrated 
that the presence of cataract significantly affects the RNFL 
thickness measurements by Cirrus SD OCT and Stratus TD 
OCT. The changes in the RNFL thickness measurements 
following cataract surgery were more prominent for Cirrus SD 
OCT than Stratus OCT [20]. The fact that Cirrus OCT showed 
more apparent changes of RNFL thickness measurements after 
cataract surgery does not necessarily mean a lower 
performance in terms of RNFL thickness measurements in 



eyes with media opacity. As Stratus OCT and Cirrus OCT 
use a different data acquisition process with a different 
speed, we could speculate that more reliable measurements 
in pseudophakic eyes based on Cirrus OCT might have 
affected the results of the previous study [20]. Cirrus OCT 
uses a line scanning ophthalmoscope with a 750 nm 
superluminescent diode as a light source and this provides 
clear pupil visualization and fundus image focusing. Thus, 
the Cirrus OCT scan quality may be better than those 
obtained with Stratus OCT. Moreno -Montanes et al. [21] 
also revealed that Cirrus OCT has better SS than Stratus OCT 
with similar conditions of pupillary dilatation or lens 
transparency. From all these considerations, similar 
reproducibility in RNFL thickness measurement using Cirrus 
OCT between pseudophakic and clear media eyes in the 
current study offers some support to our hypothesis that 
RNFL thickness measurement obtained by Cirrus OCT in 
pseudophakic eyes might be less variable than that obtained 
by Stratus OCT 

As we expected, the average SS in the pseudophakic group 
was somewhat lower than that in the clear media group. Na 
et al. [22] demonstrated that age, visual acuity, and extent of 
cataracts were associated with SS obtained by Cirrus OCT. 
One possible explanation for lower SS in the pseudophakic 
group is that surface light scattering or reflection on the 
intraocular lens implanted after cataract surgery might 
induce optical disturbance and impair light transmission. 
Alternatively, the presence of slight posterior capsular 
opacity might decrease the amount of light that passes 
through optical media, which SS strongly depends on. 
However, despite of lower SS values, the reproducibility of 
RNFL thickness and color code values in the pseudophakic 
group was comparable with that in the clear media group. It 
is likely that the SS of the pseudophakic group was not poor 
enough to reduce the reproducibility of RNFL thickness or 
color code in this study using Cirrus OCT. Wu et al. [23] 
reported that lower SS is associated with thinner RNFL 
thickness obtained by Stratus OCT in scans with SS values 
less than 7. On the other hand. Ha et al. [24] suggested a SS 
score of 4 was the lowest acceptable limit of SS for reproducible 
Stratus OCT scanning. Thus, special attention should be given 
to changes of SS when assessing RNFL thickness, particularly 
in glaucomatous patients with combined cataract or in those 
who have undergone cataract surgery recently. 

Cheng et al. [10] also investigated the influence of 
cataract on RNFL thickness measurements with Cirrus 
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OCT and Stratus OCT. After removal of cataract, the 
observed SS value was significantly increased in both 
Cirrus and Stratus OCT scans, while ICC value appeared 
to be significantly increased only via Stratus OCT. 
However, in our study using Cirrus OCT, the observed SS 
value was slightly higher in the pseudophakic group than in 
cataract group without statistical significance. Furthermore, 
the ICC value was significantly higher in the pseudophakic 
group than in the cataract group, especially in the superior 
and nasal quadrants. The discrepancy of results between 
the two studies might come from different study designs. 
The study by Cheng et al. [10] enrolled only small number 
of cataract patients without any other ocular pathology and 
compared reproducibility of preoperative and postoperative 
OCT evaluation in the same population. On the other hand, 
our study enrolled a large number of glaucomatous patients 
and compared reproducibility of Cirrus OCT evaluation 
among different groups classified according to patients' 
lens status. 

There are several strengths of our study. First, a large 
population of 205 patients were enrolled indicating that our 
study has sufficient statistical power. Second, all participants 
were classified into three different groups according to lens 
status by a single experienced ophthalmologist (JHK). 
Third, as a single experienced technician operated all OCT 
scans, inter-operator variability was minimized. 

The current study has several limitations. First, some 
patients with minimal lens opacity might be classified into 
clear media group considering the mean age of study 
population was over 60 years old. These ambiguities in 
group classification may have adverse effects on our results. 
Second, a direct comparison of reproducibility with Cirrus 
OCT and Stratus OCT RNFL thickness measurements in 
pseudophakic eyes was not allowed since we did not have 
both devices in our clinic. Third, due to limited particip- 
ation of patients, we were not able to compare the reprod- 
ucibility observed with preoperative and postoperative 
scans in the same patients. Further studies are required to 
ascertain the effect of lens status on reproducibility of 
Cirrus OCT according to different stages of glaucoma. 

The present study demonstrated that the Cirrus OCT 
measurements of cpRNFL thickness were very reproducible in 
pseudophakic eyes, as well as in clear media eyes. However, 
even after successful cataract surgery, there is a possibility of 
SS attenuation in comparison with clear media eyes, probably 
due to the interference of light transmittance by implanted 



intraocular lens. Thus, when interpreting the results of Cirrus 
OCT scans in pseudophakic eyes, factors that can compromise 
the test results should be carefully considered. 
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